Systems and methods for stabilizing videos

ABSTRACT

A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.

FIELD

This disclosure relates to stabilizing videos based on dynamic field ofview adjustment.

BACKGROUND

A video may have been captured by an image capture device in motion. Themotion of the image capture device during the capture of the video maycause the video to appear jerky/shaky.

SUMMARY

This disclosure relates to stabilizing videos. Video information,rotational position information, and/or other information may beobtained. The video information may define a video. The video mayinclude video content captured by an image capture device during acapture duration. The video content may have a progress length. Thevideo content may include visual content captured at different momentswithin the capture duration. The visual content may be viewable as afunction of progress through the progress length. The visual content mayhave a field of view. The rotational position information maycharacterize rotational positions of the image capture device as afunction of progress through the capture duration. A viewing window forthe visual content as a function of progress through the progress lengthmay be determined based on the rotational positions of the image capturedevice as the function of progress through the capture duration and/orother information. The viewing window may define extents of the visualcontent to be included within stabilized visual content as the functionof progress through the progress length. Determination of the viewingwindow may include determination of sizes of the viewing window as thefunction of progress through the progress length based on the rotationalpositions of the image capture device as the function of progressthrough the capture duration and/or other information. The stabilizedvisual content may be generated based on the viewing window and/or otherinformation. The stabilized visual content may include a punchout of theextents of the visual content within the viewing window.

A system that stabilizes videos may include one or more electronicstorages, one or more processors, and/or other components. An electronicstorage may store video information defining a video, informationrelating to the video, information relating to video content,information relating to visual content, information relating to an imagecapture device, information relating to a capture duration, rotationalposition information of the image capture device, information relatingto rotational positions of the image capture device, informationrelating to a viewing window, information relating to sizes of theviewing window, information relating to movement of the viewing window,information relating to stabilized visual content, information relatingto a punchout of visual content, and/or other information. In someimplementations, the system may include one or more optical elements,one or more image sensors, one or more position sensors, and/or othercomponents.

One or more components of the system may be carried by a housing, suchas a housing of an image capture device. For example, the opticalelement(s), the image sensor(s), and/or the position sensor(s) of thesystem may be carried by the housing of an image capture device. Thehousing may carry other components, such as the processor(s) and/or theelectronic storage.

The processor(s) may be configured by machine-readable instructions.Executing the machine-readable instructions may cause the processor(s)to facilitate stabilizing videos. The machine-readable instructions mayinclude one or more computer program components. The computer programcomponents may include one or more of a video information component, aposition information component, a viewing window component, a generationcomponent, and/or other computer program components.

The video information component may be configured to obtain videoinformation and/or other information. Video information may define avideo. The video may include video content captured by an image capturedevice during a capture duration. The video content may have a progresslength. The video content may include visual content captured atdifferent moments within the capture duration. The visual content may beviewable as a function of progress through the progress length. Thevisual content may have a field of view.

The position information component may be configured to obtainrotational position information of the image capture device and/or otherinformation. The rotational position information may characterizerotational positions of the image capture device as a function ofprogress through the capture duration.

The viewing window component may be configured to determine a viewingwindow for the visual content as a function of progress through theprogress length based on the rotational positions of the image capturedevice as the function of progress through the capture duration and/orother information. The viewing window may define extents of the visualcontent to be included within stabilized visual content as the functionof progress through the progress length. Determination of the viewingwindow may include determination of sizes of the viewing window as thefunction of progress through the progress length based on the rotationalpositions of the image capture device as the function of progressthrough the capture duration and/or other information.

In some implementations, changes in the sizes of the viewing window asthe function of progress through the progress length may simulatechanges in zoom of the visual content. In some implementations, theviewing window may be determined to have a minimum of the sizes of theviewing window over the progress length. In some implementations, theviewing window may be determined to have the sizes as the function ofprogress through the progress length. In some implementations, theviewing window may be determined to have smoothed changes in the sizesas the function of progress through the progress length.

In some implementations, the determination of the viewing window mayinclude determination of maximum extents of the visual content forplacement of the viewing window as the function of progress through theprogress length based on the rotational positions of the image capturedevice as the function of progress through the capture duration and/orother information. In some implementations, the sizes of the viewingwindow may be smaller than the maximum extents of the visual content,and the viewing window may move within the maximum extents of the visualcontent to generate one or more panning views.

In some implementation, the viewing window component may be furtherconfigured to rotate the visual content to level the visual content asthe function of progress through the progress length based on therotational positions of the image capture device as the function ofprogress through the capture duration and/or other information. Therotation of the visual content may be effectuated through rotation ofthe visual content itself and/or through orientation of the viewingwindow with respect to the field of view of the visual content.

The generation component may be configured to generate the stabilizedvisual content based on the viewing window and/or other information. Thestabilized visual content may include a punchout of the extents of thevisual content within the viewing window. In some implementations, thestabilized visual content may be generated as a director track thatdefines the extents of the visual content to be used during playback.

In some implementations, the stabilized visual content may be generatedbased on the viewing window having the minimum of the sizes of theviewing window over the progress length and/or other information. Insome implementations, the stabilized visual content may be generatedbased on the viewing window having the sizes as the function of progressthrough the progress length and/or other information. In someimplementations, the stabilized visual content may be generated based onthe viewing window having smoothed changes in the sizes as the functionof progress through the progress length and/or other information.

These and other objects, features, and characteristics of the systemand/or method disclosed herein, as well as the methods of operation andfunctions of the related elements of structure and the combination ofparts and economies of manufacture, will become more apparent uponconsideration of the following description and the appended claims withreference to the accompanying drawings, all of which form a part of thisspecification, wherein like reference numerals designate correspondingparts in the various figures. It is to be expressly understood, however,that the drawings are for the purpose of illustration and descriptiononly and are not intended as a definition of the limits of theinvention. As used in the specification and in the claims, the singularform of “a,” “an,” and “the” include plural referents unless the contextclearly dictates otherwise.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example system that stabilizes videos.

FIG. 2 illustrates an example method for stabilizing videos.

FIG. 3 illustrates an example image capture device.

FIG. 4 illustrates example orientations of viewing windows with respectto images.

FIG. 5A illustrates example images captured by an image capture devicefrom different rotational positions.

FIG. 5B illustrates an example overlapping portion between the imagesshown in FIG. 5A.

FIG. 5C illustrates an example viewing window within the overlappingportion shown in FIG. 5B.

FIG. 5D illustrates an example overlapping portion between images.

FIG. 5E illustrates example leveling of an image.

FIGS. 6A-6C illustrate example zoom curves.

DETAILED DESCRIPTION

FIG. 1 illustrates a system 10 for stabilizing videos. The system 10 mayinclude one or more of a processor 11, an interface 12 (e.g., bus,wireless interface), an electronic storage 13, and/or other components.In some implementations, the system 10 may include one or more opticalelements, one or more image sensors, one or more position sensors,and/or other components. Video information, rotational positioninformation, and/or other information may be obtained by the processor.The video information may define a video. The video may include videocontent captured by an image capture device during a capture duration.The video content may have a progress length. The video content mayinclude visual content captured at different moments within the captureduration. The visual content may be viewable as a function of progressthrough the progress length. The visual content may have a field ofview. The rotational position information may characterize rotationalpositions of the image capture device as a function of progress throughthe capture duration.

A viewing window for the visual content as a function of progressthrough the progress length may be determined based on the rotationalpositions of the image capture device as the function of progressthrough the capture duration and/or other information. The viewingwindow may define extents of the visual content to be included withinstabilized visual content as the function of progress through theprogress length. Determination of the viewing window may includedetermination of sizes of the viewing window as the function of progressthrough the progress length based on the rotational positions of theimage capture device as the function of progress through the captureduration and/or other information. The stabilized visual content may begenerated based on the viewing window and/or other information. Thestabilized visual content may include a punchout of the extents of thevisual content within the viewing window.

The electronic storage 13 may be configured to include electronicstorage medium that electronically stores information. The electronicstorage 13 may store software algorithms, information determined by theprocessor 11, information received remotely, and/or other informationthat enables the system 10 to function properly. For example, theelectronic storage 13 may store video information defining a video,information relating to the video, information relating to videocontent, information relating to visual content, information relating toan image capture device, information relating to a capture duration,rotational position information of the image capture device, informationrelating to rotational positions of the image capture device,information relating to a viewing window, information relating to sizesof the viewing window, information relating to movement of the viewingwindow, information relating to stabilized visual content, informationrelating to a punchout of visual content, and/or other information.

The processor 11 may be configured to provide information processingcapabilities in the system 10. As such, the processor 11 may compriseone or more of a digital processor, an analog processor, a digitalcircuit designed to process information, a central processing unit, agraphics processing unit, a microcontroller, an analog circuit designedto process information, a state machine, and/or other mechanisms forelectronically processing information. The processor 11 may beconfigured to execute one or more machine-readable instructions 100 tofacilitate stabilizing videos. The machine-readable instructions 100 mayinclude one or more computer program components. The machine-readableinstructions 100 may include one or more of a video informationcomponent 102, a position information component 104, a viewing windowcomponent 106, a generation component 108, and/or other computer programcomponents.

Visual content (of image(s), of video frame(s), of video(s)) with afield of view may be captured by an image capture device during acapture duration. A field of view of visual content may define a fieldof view of a scene captured within the visual content. A captureduration may be measured/defined in terms of time durations and/or framenumbers. For example, visual content may be captured during a captureduration of 60 seconds, and/or from one point in time to another pointin time. As another example, 1800 images may be captured during acapture duration. If the images are captured at 30 images/second, thenthe capture duration may correspond to 60 seconds. Other capturedurations are contemplated.

The system 10 may be remote from the image capture device or local tothe image capture device. One or more portions of the image capturedevice may be remote from or a part of the system 10. One or moreportions of the system 10 may be remote from or a part of the imagecapture device. For example, one or more components of the system 10 maybe carried by a housing, such as a housing of an image capture device.For instance, optical element(s), image sensor(s), and/or positionsensor(s) of the system 10 may be carried by the housing of the imagecapture device. The housing may carry other components, such as theprocessor 11 and/or the electronic storage 13. References to a housingof an image capture device may refer to the image capture device, andvice versa. For example, references to position/motion of a housing ofan image capture device may refer to position/motion of the imagecapture device, and vice versa.

An image capture device may refer to a device for recording visualinformation in the form of images, videos, and/or other media. An imagecapture device may be a standalone device (e.g., camera) or may be partof another device (e.g., part of a smartphone, tablet). FIG. 3illustrates an example image capture device 302. The image capturedevice 302 may include a housing 312, and the housing 312 may carry (beattached to, support, hold, and/or otherwise carry) an optical element304, an image sensor 306, a position sensor 308, a processor 310, and/orother components. Other configurations of image capture devices arecontemplated.

The optical element 304 may include instrument(s), tool(s), and/ormedium that acts upon light passing through theinstrument(s)/tool(s)/medium. For example, the optical element 304 mayinclude one or more of lens, mirror, prism, and/or other opticalelements. The optical element 304 may affect direction, deviation,and/or path of the light passing through the optical element 304. Theoptical element 304 may have a field of view 305. The optical element304 may be configured to guide light within the field of view 305 to theimage sensor 306. The field of view 305 may include the field of view ofa scene that is within the field of view of the optical element 304and/or the field of view of the scene that is delivered to the imagesensor 306. For example, the optical element 304 may guide light withinits field of view to the image sensor 306 or may guide light within aportion of its field of view to the image sensor 306. The field of view305 of the optical element 304 may refer to the extent of the observableworld that is seen through the optical element 304. The field of view305 of the optical element 304 may include one or more angles (e.g.,vertical angle, horizontal angle, diagonal angle) at which light isreceived and passed on by the optical element 304 to the image sensor306. In some implementations, the field of view 305 may be greater thanor equal to 180-degrees. In some implementations, the field of view 305may be smaller than or equal to 180-degrees.

The field of view 305 may be larger than a size of the punchout/viewingwindow used to generate stabilized visual content. Portions of thevisual content captured from light within the field of view 305 may bepresented on a display and/or used to generate a video. The portions ofthe visual content presented on the display/used to generate a video mayinclude those portions of the visual content within a viewing window. Aviewing window may define extents of the visual content (e.g., ofimage(s)/video frame(s)) to be included within a punchout. The viewingwindow may be determined so that the visual content within thepresentation/generated video does not appear shaky/jerky or appears lessshaky/jerky. For example, the shape, size, and/or the location of theviewing window within the visual content may be determined to compensatefor motion of the image capture device 302 during capture such that thevideo appears to have been captured from an image capture device 302with less motion. That is, the visual content captured by the imagecapture device 302 may be cropped to generate stabilized visual content.

The image sensor 306 may include sensor(s) that converts received lightinto output signals. The output signals may include electrical signals.For example, the image sensor 306 may include one or more of acharge-coupled device sensor, an active pixel sensor, a complementarymetal-oxide semiconductor sensor, an N-type metal-oxide-semiconductorsensor, and/or other image sensors. The image sensor 306 may generateoutput signals conveying information that defines visual content of oneor more images and/or one or more video frames of a video. For example,the image sensor 306 may be configured to generate a visual outputsignal based on light that becomes incident thereon during a captureduration. The visual output signal may convey visual information thatdefines visual content having the field of view.

The position sensor 308 may include sensor(s) that measures experiencedpositions and/or motions. The position sensor 308 may convertexperienced positions and/or motions into output signals. The outputsignals may include electrical signals. For example, the position sensor308 may refer to a set of position sensors, which may include one ormore inertial measurement units, one or more accelerometers, one or moregyroscopes, and/or other position sensors. The position sensor 308 maygenerate output signals conveying information that characterizespositions and/or motions of the position sensor 308 and/or device(s)carrying the position sensor 308, such as the image capture device 302and/or the housing 312.

For example, the position sensor 308 may be configured to generate aposition output signal based on positions of the image capture device302 during the capture duration. The position output signal may conveyposition information that characterizes positions of the image capturedevice 302 at different moments (points in time, time durations) withinthe capture duration. The position information may characterizepositions of the image capture device 302 based on specifictranslational and/or rotational positions of the image capture device302 and/or based on changes in translational and/or rotational positionsof the image capture device 302 as a function of progress through thecapture duration. That is, the position information may characterizetranslational and/or rotational positions of the image capture device302 and/or changes in translational and/or rotational positions (motion)of the image capture device 302 (e.g., direction, amount, velocity,acceleration) during the capture duration.

The position information may be determined based on signals generated bythe position sensor 308 and independent of the information/signalsgenerated by the image sensor 306. That is, position information may bedetermined without using visual content/images/videos generated by theimage sensor 306. Use of visual content/images/videos to determinepositions/motions of the image capture device 302 may be computationallyexpensive in terms of processing power, processing time, and/or batteryconsumption. Using the information/signals from the position sensor 308to determine positions/motions of image capture device 302 may becomputationally cheaper. That is, less processing power, processingtime, and/or battery consumption may be required when positions/motionsof the image capture device 302 are determined from theinformation/signals from the position sensor 308 than theinformation/signals from the image sensor 306. The position informationdetermined independent of the image information may be used to determinethe positions of the image capture device 302 during the captureduration.

In some implementations, the position information may include data fromthe position sensor (e.g., gyroscope data, accelerometer data) with timestamps per visual content capture at different moments. For example, theposition may include gyroscope data and/or accelerometer data perindividual video frames captured by the image capture device. In someimplementations, calibration of an inertial measurement unit may be usedto combine different data within the position information.

The processor 310 may include one or more processors (logic circuitry)that provide information processing capabilities in the image capturedevice 302. The processor 310 may provide one or more computingfunctions for the image capture device 302. The processor 310 mayoperate/send command signals to one or more components of the imagecapture device 302 to operate the image capture device 302. For example,the processor 310 may facilitate operation of the image capture device302 in capturing image(s) and/or video(s), facilitate operation of theoptical element 304 (e.g., change how light is guided by the opticalelement 304), and/or facilitate operation of the image sensor 306 (e.g.,change how the received light is converted into information that definesimages/videos and/or how the images/videos are post-processed aftercapture).

The processor 310 may obtain information from the image sensor 306and/or the position sensor 308, and/or facilitate transfer ofinformation from the image sensor 306 and/or the position sensor 308 toanother device/component. The processor 310 may be remote from theprocessor 11 or local to the processor 11. One or more portions of theprocessor 310 may be part of the processor 11 and/or one or moreportions of the processor 10 may be part of the processor 310. Theprocessor 310 may include and/or perform one or more functionalities ofthe processor 11 shown in FIG. 1.

For example, the processor 310 may use the position information tostabilize visual content captured through the optical element 304 and/orthe image sensor 306. Visual content having a field of view may becaptured by the image capture device 302 during a capture duration. Theprocessor 310 may determine the rotational positions of the imagecapture device as a function of progress through the capture durationand use the rotational positions of the image capture device todetermine placement of the viewing window within the field of view ofthe visual content. The placement of the viewing window within the fieldof view of the visual content may include one or more of changing thesize of the viewing window, changing the shape of the viewing window,and/or changing the location of the viewing window within the field ofview based on the rotational positions of the image capture device. Thevisual content within the viewing window may be used (e.g., cropped) togenerate stabilized visual content. For example, the size of the viewingwindow may be increased and/or decreased based on the rotationalpositions of the image capture device as a function of progress throughthe capture duration and different sizes of extents of the visualcontent may be cropped to stabilize the visual content.

Stabilization of visual content may be performed based on placement ofthe viewing window within the field of view of the visual content. Theplacement of the viewing window may compensate for the motion of theimage capture device during the capture duration. For example, a viewingwindow having a smaller size than the field of view of the visualcontent may be used to provide a punchout of the visual content. Thepunchout (cropped view) may be moved within the field of view to providea stabilized view of the visual content.

The viewing window may be oriented with respect to the field of view ofthe visual content to provide a punchout of the visual content that isstable with respect to prior and/or next punchout of the visual content.For example, the viewing window may be oriented with respect to thefield of view of images/video frames captured by the image capturedevice to provide a punchout of the images/video frames such that thepresented content appears to have been captured with a stable/morestable image capture device (e.g., a punchout of a video frame beingstable/more stable with a punchout of the preceding video frame and/or asubsequent video frame).

For example, FIG. 4 example orientations of viewing windows 404, 414,424 with respect to images 400, 410, 420. The images 400, 410, 420 mayhave a field of view 402. The viewing windows 404, 414, 424 may have apunchout field of view 406. The images 400, 410, 420 may include captureof a scene within an angle defined by the field of view 402. The viewingwindows 404, 414, 424 may provide a punchout of the images 400, 410, 420to be used for video stabilization. The punchout field of view 406 ofthe viewing windows 404, 414, 424 may be smaller than the field of view402 of the images 400, 410, 420. The difference between the field ofview 402 and the punchout field of view 406 may define a margin 408within which the viewing window 404 may move with respect to the image A400/field of view 402. The margin 408 may specify how much the viewingwindow 404 may move while remaining inside the field of view 402 of thevisual content included within the image A 402.

Placements of the viewing window 404, 414, 424 within the field of view402 (orientation of the viewing window 404 with respect to the field ofview 402) may be changed to perform video stabilization. For example,the viewing window 414 may be rotated with respect to the field of view402 of the image B 610 while not going beyond the pixels captured withinthe image B 610. The viewing window 424 may be laterally moved withrespect to the field of view 402 of the image C 420 while not goingbeyond the pixels captured within the image C 420. The placements of theviewing window 404, 414, 424 may be determined based on the rotationalpositions of the image capture device when the images 400, 410, 420 werecaptured.

For instance, the viewing window 414 may be oriented with respect to thefield of view 402 of the image B 610 to provide a punchout of the imageB 610 that is stable with respect to a prior and/or next punchout of theimages (e.g., stable with the punchout of the image A 400 using theviewing window 404 for the image A 400). The orientation of the viewingwindow 414 with respect to the field of view 402 of the image B 610 maybe determined based on the rotational position of the image capturedevice from which the image B 610 was captured. Similarly, the viewingwindow 424 may be oriented with respect to the field of view 402 of theimage C 420 to provide a punchout of the image C 420 that is stable withrespect to a prior and/or next punchout of the images (e.g., stable withthe punchout of the image B 410 using the viewing window 414 for theimage B 410).

Smaller sizes of the punchout/viewing window (e.g., smaller punchoutfield of view) may enable greater stabilization of motion within thevisual content caused by the motion of the image capture device. Using asmaller punchout/viewing window may enable the punchout to be moved togreater extent before the punchout hits an edge of the visual content.However, smaller punchout/viewing window may provide a smaller view(smaller portion) of the visual content.

The size of the punchout/viewing window may be dynamically changed basedon the rotational positions of the image capture device. For example,motion (e.g., shake, jitter, jerk) of the visual content may beestimated based on readings from the position sensor of the imagecapture device. The rotational positions of the image capture device asthe function of progress through the capture duration may be used todetermine/estimate how much motion is within the visual content due tomotion of the image capture device (e.g., shaking/vibration of the imagecapture device). The size of the punchout/viewing window may be changed(e.g., increased, decreased) based on the motion. For example, largeramount of motion may result in the size of the punchout being decreasedwhile smaller amount of motion may result in the size of the punchoutbeing increased. Such dynamic change in the size of the punchout mayenable generation of a stabilized visual content that includes greaterextent of the original visual than if a fixed-sized punchout/viewingwindow is used. The stabilized visual content may include differentextents of the original visual content based on the motion of the imagecapture device during the capture duration. The size of thepunchout/viewing window may be expressed in terms of field of view(field of view of visual content versus field of view of the viewingwindow), in terms of megapixels (megapixel of the visual content versusmegapixel of the punchout), and/or in other terms.

FIG. 5A illustrates example images 512, 514 captured by an image capturedevice 502 from different rotational positions. The image 512 may becaptured by the image capture device 502 while the image capture device502 is leveled with respect to ground. The image 512 may include visualcontent depicting leveled scene within the field of view of the imagecapture device 502. The image 514 may be captured by the image capturedevice 502 while the image capture device 502 is rotated to the right.The image 514 may include visual content depicted tilted scene withinthe field of view of the image capture device 502.

FIG. 5B illustrates an example overlapping portion 522 between theimages 512, 514 shown in FIG. 5A. The images 512, 514 may be captured bythe image capture device 502 while pointed/centered at the samedirection/point. Different rotations of the image capture device 502during capture of the images 512, 514 may result in different portionsof the scene being captured within the images 512, 514. The images 512,514 may include pixels that represent same portions of the scenedepicted within the images 512, 514. For example, the rotation of theimage capture device 502 between capture of the images 512, 514 maycause the overlapping portion 522 of the images 512, 514 to includepixels that depict the same portions of the scene. The overlappingportion 522 may include the portions of the images 512, 514 that may beused to generate a stabilized view of the images 512, 514. That is, apunchout of the images 512, 514 from the overlapping portion 522 may beused to stabilize views of the images 512, 514.

FIG. 5C illustrates an example viewing window 532 within the overlappingportion 522 shown in FIG. 5B. The viewing window 532 may be locatedwithin the overlapping portion 522 to provide a stabilized view of theimages 512, 514. For example, the images 512, 514 may represent adjacentvideo frames, and the viewing window 532 may be positioned within thefield of view of the images 512, 514 as shown in FIG. 5C (within theoverlapping portion 522) such that the punchout of the images 512, 514shows visual content that appears to have been captured by the imagecapture device 502 without rotational motion.

FIG. 5D illustrates an example overlapping portion 524 between images512, 516. As shown in FIG. 5A, the image 512 may be captured by theimage capture device 502 while the image capture device 502 is leveledwith respect to ground. The image 516 may be captured by the imagecapture device 502 while the image capture device 502 is rotated to theright by 90 degrees. The image 516 may include visual content depictedright-angle tilted scene within the field of view of the image capturedevice 502. The rotation of the image capture device 502 between captureof the images 512, 516 may cause the overlapping portion 524 of theimages 512, 516 to include pixels that depict the same portions of thescene. The overlapping portion 524 may include the portions of theimages 512, 516 that may be used to generate a stabilized view of theimages 512, 516.

The amount of rotation of the image capture device between the originalrotation (e.g., rotational position of the image capture device 502during capture the initial image, first video frame) and the subsequentrotation (e.g., rotational position of the image capture device 502during subsequent capture of another image, second video frame) maydetermine the size of the overlapping portion between the images. Thesize of the overlapping portion may determine the size of the viewingwindow that may be used to provide a stabilized punchout of the visualcontent within the images. Larger sizes of the overlapping portion mayenable larger sizes of the viewing window and smaller sizes of theoverlapping portion may require smaller sizes of the viewing window.That is, smaller sizes of the overlapping portion may limit the sizes ofthe viewing window. For example, the overlapping portion 522 (shown inFIGS. 5B, 5C) may be larger than the overlapping portion 524 (shown inFIG. 5D). The size of the viewing widow that may be used to stabilizethe images 512, 514 may be larger than the size of the viewing windowthat may be used to stabilize the images 512, 516. That largest size(maximum size) of the viewing window that may be used stabilize theimages 512, 516 may be smaller than the largest size (maximum size) ofthe viewing window that may be used stabilize the images 512, 514because the overlapping portion 524 is smaller than the overlappingportion 522.

In some implementations, the changes in the maximum size of the viewingwindow that may be used to stabilize visual content based on rotation ofthe image capture device may be used to change the zoom level of theimage capture device used to capture visual content. Use of buttons,switches, dials, and/or other features of the image capture device thatneeds to be engaged to change the zoom level of the image capture devicemay interfere with visual content capture. For example, a user engaginga button, a switch, and/or a dial to control the zoom level may take theuser's attention away from the visual content being captured and/or mayadversely impact the positioning of the image capture device (e.g.,cause the image capture device to shake, tilt). Requiring suchinteraction by the user with the image capture device may take time. Forexample, when a user wishes to zoom-in and/or zoom-out, the user mayneed to locate the corresponding zoom button/switch/dial and engage thezoom button/switch/dial to change the zoom level.

Rather than requiring such interaction by the user with the imagecapture device, the zoom level of the image capture device may bechanged based on rotation of the image capture device. For example, thezoom-level of the image capture device may correspond to the maximumsize of the viewing window that may be used to stabilized visual contentcapture by the image capture device. The image capture device maymonitor the initial rational position of the image capture device when asequence of images (e.g., video frames, burst images) are beingcaptured.

When the image capture device is rotated away from the initialrotational position, the zoom level of the image capture device may beincreased (e.g., larger than 1×) with the extent of the visual contentthat is captured including and/or being smaller than the maximum size ofthe viewing window allowed based on the image capture device rotation.When the image capture device is rotated back towards the initialrotational position, the zoom level of the image capture device may bedecreased (e.g., towards 1×) with the extent of the visual content thatis captured including and/or being smaller than the maximum size of theviewing window allowed based on the image capture device rotation.

For example, referring to FIG. 5A, the image capture device 502 may beused to capture a video (visual content of video frames). The capture ofthe video may start with the image capture device 502 leveled to capturethe image 512 (initial video frame). During the capture of the video,the image capture device 502 may be rotated to capture the image 514(subsequent video frame). The rotation of the image capture device 502from the initial rotational position may cause the zoom level of theimage capture device 502 to be increased (with the extent of the visualcontent that is captured including and/or being smaller than the maximumsize of the viewing window allowed based on the rotation of the imagecapture device 502). The rotation of the image capture device 502 backtowards the initial rotational position may cause the zoom level of theimage capture device 502 to be decreased.

Changing the zoom level of the image capture device based on therotation of the image capture device may allow the user to capturevisual content with different zoom levels without interfering with thevisual content capture. Such changing of the zoom level may allow theuser to change zoom level with changing how the image capture device isbeing held (e.g., not having to take a hand/fingers away from holdingthe image capture device to operate the zoom button). Such changing ofthe zoom level may allow the user to change zoom level by simplyrotating the image capture device and may not require the user to haveto find and/or engaged with zoom button/switch/dial to change the zoomlevel.

In some implementations, the visual content captured by the imagecapture device may be leveled as the function of progress through theprogress length based on the rotational positions of the image capturedevice as the function of progress through the capture duration and/orother information. That is, the visual content captured by the imagecaptured device may be rotated to compensate for rotation of the imagecapture device during the capture duration such that a view of thevisual content includes depiction of leveled scene. For example,readings from the position sensor may be used to determine the directionof gravity when visual content is captured at different moments withinthe capture duration. The direction of gravity may be used to determinethe amount of rotation that needs to be applied to the visual content tolevel the depiction within the visual content. For example, the visualcontent may be rotated so that the direction of gravity is pointeddownwards.

The rotation of the visual content may be effectuated through rotationof the visual content itself and/or through orientation of the viewingwindow with respect to the field of view of the visual content. Forexample, FIG. 5E illustrates example leveling of an image 518. The image518 may be captured by an image capture device that is rotated to theright with respect to ground. For example, the image 518 may be capturedby the image capture device 502 rotated to the right to capture theimage 514 (shown in FIG. 5A). Such rotation of the image capture devicemay result in the visual content including tilted depiction of thecapture scene. Viewing the image 518 may show upright objects within thescene to be depicted as being tilted to the left. The visual content ofthe image 518 may be rotated based on the rotational position of theimage capture device during capture of the image 518 to provide leveledview of the scene. For example, the visual content of the image 518 maybe rotated to the right so that upright objects within the scene appearsupright. A viewing window 534 may be positioned in an upright mannerwithin the leveled visual content of the image 518 to provide an uprightpunchout (leveled view) of the scene. As another example, a viewingwindow 536 may be position within unleveled visual content of the image518. The viewing window 536 may be positioned in a tilted manner withinthe unleveled visual content of the image 518 to provide an uprightpunchout (leveled view) of the scene.

Referring back to FIG. 1, the processor 11 (or one or more components ofthe processor 11) may be configured to obtain information to facilitatestabilizing videos. Obtaining information may include one or more ofaccessing, acquiring, analyzing, determining, examining, identifying,loading, locating, opening, receiving, retrieving, reviewing, storing,and/or otherwise obtaining the information. The processor 11 may obtaininformation from one or more locations. For example, the processor 11may obtain information from a storage location, such as the electronicstorage 13, electronic storage of information and/or signals generatedby one or more sensors, electronic storage of a device accessible via anetwork, and/or other locations. The processor 11 may obtain informationfrom one or more hardware components (e.g., an image sensor, a positionsensor) and/or one or more software components (e.g., software runningon a computing device).

The video information component 102 may be configured to obtain videoinformation and/or other information. The video information may define avideo. For example, the video information component 102 may obtain videoinformation defining a video while the video is being captured by animage capture device. The video information component 102 may obtainvideo information defining a video after the video has been captured andstored in memory (e.g., the electronic storage 13).

In some implementations, the video information component 102 may obtainvideo information based on user interaction with a userinterface/application (e.g., video editing application, video playerapplication), and/or other information. For example, a userinterface/application may provide option(s) for a user to select one ormore videos that are to be stabilized and/or played. The videoinformation defining the video may be obtained based on the user'sselection of the video content through the user interface/videoapplication. Other selections of video are contemplated.

The video may include video content captured by an image capture deviceduring a capture duration. The video content may have a progress length.The progress length of the video content may correspond to the captureduration. The progress length of the video content may be determinedbased on the capture duration. The progress length of the video contentmay be same as the capture duration, shorter than the capture duration(e.g., playback rate of the video content is faster than the capturerate of the video content), and/or longer than the capture duration(e.g., playback rate of the video content is slower than the capturerate of the video content).

The video content may include visual content captured at differentmoments within the capture duration. The visual content may be viewableas a function of progress through the progress length. The visualcontent may have a field of view, such as the field of view 305 shown inFIG. 3. The video content may include other content, such as audiocontent. Audio content may be captured during capture of the visualcontent (e.g., recording of sound captured with the images/video frames)and/or may be captured separately from the capture of the visual content(e.g., song/music provide accompaniment for the playback of theimages/video frames, sound recorded before/after capture of theimages/video frames).

The position information component 104 may be configured to obtainrotational position information of an image capture device and/or otherinformation. The rotational position information may characterizerotational positions of the image capture device that captured the videoas a function of progress through the capture duration for the video.The position information may describe and/or define the rotationalpositions of the image capture device at different moments within thecapture duration and/or changes in rotational positions (motion) of theimage capture device at different moments within the capture duration.

The position information component 104 may obtain rotational positioninformation of the image capture device while the video is beingcaptured by the image capture device. The position information component104 may obtain rotational position information of the image capturedevice during generation of the position output signal by the positionsensor. The position information component 104 may obtain rotationalposition information of the image capture device after thevideo/position information has been captured and stored in memory (e.g.,the electronic storage 13). In some implementations, the positioninformation component 104 may be configured to obtain other positioninformation (e.g., translational position information).

The viewing window component 106 may be configured to determine aviewing window for the visual content as a function of progress throughthe progress length. One or more of shape, size, rotation, movement,and/or other characteristics of the viewing window may be determined fordifferent moments within the progress length of the visual content. Theviewing window may be determined based on the rotational positions ofthe image capture device as the function of progress through the captureduration and/or other information. One or more of shape, size, rotation,movement, and/or other characteristics of the viewing window may bedetermined for different moments within the progress length of thevisual content based on the rotational positions of the image capturedevice during corresponding moments within the capture duration and/orother information.

A viewing window may be characterized by viewing directions, viewingsizes (e.g., viewing zoom, viewing magnification), viewing rotations,and/or other information. A viewing direction may define a direction ofview for visual content. A viewing direction may define the angle/visualportion of the visual content at which the viewing window may bedirected. Changes in the viewing direction as the function of progressthrough the progress length may effectuate movement (e.g., panning) ofthe viewing window within the field of view of the visual content.

A viewing size may define a size of the viewing window. A viewing sizemay define a size (e.g., size, magnification, viewing angle) of viewableextents of visual content. A viewing size may define the dimensions ofthe viewing window. In some implementations, a viewing size may definedifferent shapes of the viewing window/viewable extents. For example, aviewing window may be shaped as a rectangle, a triangle, a circle,and/or other shapes. A viewing size may define different aspect ratiosof the viewing window (e.g., 4:3 aspect ratio, 16:9 aspect ratio, 1:1aspect ratio). Changes in the viewing size (sizes of the viewing window)as the function of progress through the progress length may simulatechanges in zoom of the visual content. The viewing size may be increasedto simulate decrease in zoom of the visual content. The viewing size maybe decreased to simulate increase in zoom of the visual content.

A viewing rotation may define a rotation of the viewing window. Aviewing rotation may define one or more rotations of the viewing windowabout one or more axis. For example, a viewing rotation may be definedbased on rotation about an axis corresponding to a viewing direction(e.g., roll). Changes in the viewing rotation as the function ofprogress through the progress length may effectuate rotation of theviewing window within the field of view of the visual content. Therotation of the viewing window may compensate for rotation of the imagecapture device during capture duration.

A viewing window may define one or more extents of the visual content. Aviewing window may define extents of the visual content to be includedwithin stabilized visual content as the function of progress through theprogress length. A viewing window may define which portions of thevisual content are included within the stabilized visual content atdifferent moment within the progress length. Inclusion of the extents ofthe visual content defined by the viewing window within the stabilizedvisual content may effectuate stabilization of the visual content.

A viewing window may be used to provide a punchout of the visualcontent. A punchout of the visual content may refer to an output of oneor more portions of the visual content for presentation (e.g., currentpresentation, future presentation based on video generated using thepunchout). A punchout of the visual content may refer to extents of thevisual content that is obtained for viewing and/or extraction. Theextents of the visual content viewable/extracted within the viewingwindow may be used to provide views of different spatial portions of thevisual content.

For example, the visual content may include a field of view, and thepunchout of the visual content may include the entire extent of thevisual content (the visual content within the entire field of view) orone or more extents of the visual content (the visual content within oneor more portions of the field of view). A viewing window may defineextents of the visual content to be included within a punchout of thevisual content as the function of progress through the progress length.A viewing window may correspond to the entire progress length or for oneor more portions (e.g., portions including moments of interest) of theprogress length. The punchout of the visual content may be presented onone or more displays, included in one or more videos, and/or otherwiseused for presenting stabilized view of the visual content.

For example, determination of the viewing window may includedetermination of sizes of the viewing window as the function of progressthrough the progress length based on the rotational positions of theimage capture device as the function of progress through the captureduration and/or other information. The sizes of the viewing window maybe determined as described above with respect to FIGS. 5A-5D.

In some implementations, the viewing window may be determined to havethe sizes as the function of progress through the progress length. Thatis, the viewing window may have the sizes that are determined based onthe rotational positions of the image capture device at differentmoments during the capture duration. For example, FIG. 6A illustrates anexample zoom curve 600. The zoom curve 600 may include values as afunction of the progress length, where the values reflect the amount ofzoom of the visual content that is required to stabilize the visualcontent. The lowest zoom may correspond to no zooming of the visualcontent (lx zoom). No zooming of the visual content may result in theentirety of the captured visual content (using largest size of theviewing window) being included within the stabilized visual content.Higher zooming of the visual content may result in smaller spatialportions of the captured visual content (using smaller sizes of theviewing window) being included within the stabilized visual content.Using the zoom values of the zoom curve may result in pronounced (e.g.,rapid, jittery) changes in zoom/viewing window size within thestabilized visual content. The zoom effect may be very pronounced withinthe stabilized visual content if the visual content was captured by animage capture device undergoing jittery/rapid rotations.

In some implementations, the viewing window may be determined to have aminimum of the sizes of the viewing window over the progress length.That is, the viewing window may have the smallest of the maximum viewingwindow size that are determined over the progress length based on therotational positions of the image capture device at different momentsduring the capture duration. For example, FIG. 6B illustrates an examplemaximum zoom curve 602. The maximum zoom curve 602 may include a singlevalue over the progress length, where the single value reflects themaximum cropping size of the visual content that allows stabilizationthe visual content over the entire progress length. The value of themaximum zoom curve 602 may be equal to or greater than the maximum valueof the zoom curve 600. Using a single size of the viewing window overthe progress length may result in the stabilized visual content notincluding zooming effects. Such a determination of the viewing size maybe beneficial for visual content captured by an image capture devicewith right instances of rotation (e.g., video captured while spinning inthe air, video captured by an image capture device inside a spinningball). However, high quality visual content (high resolution image) mayneed to be captured by the image capture device to provide a pleasantpunchout with a small viewing window size (narrow field of view).Moreover, visual content may be cropped more than needed to providestabilization.

In some implementations, the viewing window may be determined to havesmoothed changes in the sizes as the function of progress through theprogress length. That is, the sizes that are determined based on therotational positions of the image capture device may be smoothed todetermine the sizes of the viewing window used for stabilization.Smoothing of the changes in the sizes as the function of progressthrough the progress length may include removing high frequencieschanges in sizes. Smoothing of the changes in the sizes as the functionof progress through the progress length may include insertion of one ormore ramping changes in sizes. For example, based on the changes insizes including jittery increase in size over a portion of the progresslength, the jittery increase in size may be replaced with a smooth rampthat increases in size. Based on the changes in sizes including jitterydecrease in size over a portion of the progress length, the jitterydecrease in size may be replaced with a smooth ramp that decreases insize.

For example, FIG. 6C illustrates an example smoothed zoom curve 604. Thesmoothed zoom curve 604 may smoother changes in zoom than the zoom curve600. The value of the smoothed zoom curve 604 may be equal to and/orgreater than the maximum value of the zoom curve 600. Using a smoothedzoom curve may allow for rapid changes in zoom to be replaced withsmoothed zooms, creating a more cinematic feel to the stabilized videothan use of the zoom curve 600. Smoothing of the zoom curve 600 mayinclude analysis of the changes in the sizes of the viewing window asdefined by the zoom curve 600. Based on the analysis, the viewing windowmay be artificially made smaller and/or larger (e.g., artificiallyzoom-in and/or zoom-out) during moments that do not require the changein viewing window size to ramp-up and/or ramp-down to the needed viewingwindow size.

Use of different zoom curves may enable generation of stabilized visualcontent with different styles of zoom. For example, stabilized visualcontent with smoothed/dampened style of zoom may be generated based onuse of a smooth zoom curve (e.g., the smoothed zoom curve 604).Stabilized visual content with maximum zoom/no change in zoom style maybe generated based on use of a maximum zoom curve (e.g., the maximumzoom curve 602). Stabilized visual content with zoom that follows therotation of the image capture device may be generated based on the useof a non-modified zoom curve (the zoom curve 600).

Use of different zoom curves/styles may be selected by the user and/orautomatically selected. For example, a particular zoom curve/style maybe selected for use in generating stabilizing visual content based onuser interaction with a user interface/application (e.g., video editingapplication, video player application), and/or other information. Forinstance, a user interface/application may provide option(s) for a userto select one or more of the zoom curves/styles to be used for visualcontent stabilization. As another example, a particular zoom curve/stylemay be selected for use in generating stabilizing visual content basedon the rotational positions of the image capture device as a function ofprogress through the capture duration, the sizes of the viewing windowdetermined as the function of progress through the progress length basedon the rotational positions of the image capture device, on the contentcaptured within the visual content (e.g., activity identification,subject identification, face identification, emotion identification),and/or other information. Other selections of zoom curves/styles arecontemplated.

In some implementations, determination of the viewing window may includedetermination of shape, rotation, movement, and/or other characteristicsof the viewing window as the function of progress through the progresslength. For example, the shape of the viewing window may be selected asbeing rectangular or circular and/or to have a particular aspect ratio(e.g., 4:3 aspect ratio, 16:9 aspect ratio, 1:1 aspect ratio) based onuser selection, the rotational positions of the image capture device,the content captured within the visual content (e.g., activityidentification, subject identification, face identification, emotionidentification), and/or other information. For instance, a particularaspect ratio may be selected to include depiction of one or moreparticular things (e.g., a person, an activity) within the viewingwindow, a particular aspect ratio may be selected to frame depiction ofone or more particular things (e.g., a face) in a particular mannerwithin the viewing window, and/or a particular aspect ratio may beselected to maximize the extent of the visual content included withinthe viewing window. In some implantations, the viewing window may bepositioned to include one or more particular depictions (e.g., faces,smiles) within the viewing window.

In some implementations, determination of the viewing window may includedetermination of maximum extents of the visual content for placement ofthe viewing window as the function of progress through the progresslength based on the rotational positions of the image capture device asthe function of progress through the capture duration and/or otherinformation. That is, the maximum extents of the visual content that maybe stabilized may be determined for different moments within theprogress length of the visual content. The sizes of the viewing windowmay be equal to or smaller than the maximum extents of the visualcontent that may be stabilized. Using smaller sizes of the viewingwindow may allow for the viewing window to movement within the maximumextents of the visual content.

Movement of the viewing window within the maximum extents of the visualcontent may generate one or more panning views. For example, referringto FIG. 5C, the viewing window 532 may be smaller than the overlappingportion 522. The viewing window 532 may move within the overlappingportion 522 to provide punchout of different spatial extents ofdifferent image (e.g., for a sequence of video frames having theoverlapping portion 522). The border of the overlapping portion 522 mayform the boundaries within which the viewing window 532 may move. Forexample, the viewing window 532 may move along one or more of theborders of the overlapping portion 522 and/or move across theoverlapping portion 522 without touching the borders. Such movement ofthe viewing window may simulate panning of the image capture device invisual content capture (e.g., panning up and down, side to side).

In some implementation, the viewing window component 106 may be furtherconfigured to rotate the visual content to level the visual content asthe function of progress through the progress length based on therotational positions of the image capture device as the function ofprogress through the capture duration and/or other information. Rotationof the visual content may be determined for different moments within theprogress length of the visual content. The visual content may be rotatedto compensate for rotation of the image capture device during thecapture duration such that a view of the visual content includesdepiction of leveled scene.

In some implementations, the direction of gravity for visual contentcapture at different may be used to determine the amount of rotationthat needs to be applied to the visual content to level the depictionwithin the visual content. For example, the visual content may berotated so that the direction of gravity is pointed downwards. Therotation of the visual content may be effectuated through rotation ofthe visual content itself and/or through orientation of the viewingwindow with respect to the field of view of the visual content. Thevisual content may be rotated to level the visual content as describedabove with respect to FIG. E.

The generation component 108 may be configured to generate stabilizevisual content based on one or more viewing window and/or otherinformation. The stabilized visual content may include a punchout of theextent(s) of the visual content within the viewing window(s). Stabilizedvisual content may be generated to provide a smoother view of the visualcontent. Stabilization may include using smaller portions/extents of thevisual content to provide a punchout view of the visual content thatcreates a more stable view than when viewing the entirety of the visualcontent. Generation of stabilized visual content may include usingsmaller visual portions of the captured visual content (e.g., smallervisual portions of images/video frames within the viewing window) toprovide a punchout view of the captured visual content. The stabilizedvisual content may provide a more stable view of the visual content thanwhen the entirety of the visual content is presented.

In some implementations, stabilized visual content may be generated asimages/video frames including extent(s) of the visual content within theviewing window(s). Stabilized visual content may be generated as outputsof portions of the visual captured by the image capture device, with theoutputted portions including extent(s) of the visual content within theviewing window(s). Inclusion of the extent(s) of the visual contentwithin the viewing windows in video may effectuate stabilization of thevisual content via selective cropping. The portions of the visualcontent that are cropped for stabilization may depend on the rotationalpositions of the image capture device during the capture duration and/orother information.

In some implementations, the stabilized visual content may be generatedbased on the viewing window having the sizes as the function of progressthrough the progress length and/or other information. That is, theviewing window for generating the stabilized visual content may have thesizes that are determined based on the rotational positions of the imagecapture device at different moments during the capture duration. Forexample, the stabilized visual content may be generated based on thezoom curve 600 shown in FIG. 6A.

In some implementations, the stabilized visual content may be generatedbased on the viewing window having the minimum of the sizes of theviewing window over the progress length and/or other information. Thatis, the viewing window for generating the stabilized visual content mayhave the smallest of the maximum viewing window size that are determinedover the progress length based on the rotational positions of the imagecapture device at different moments during the capture duration. Forexample, the stabilized visual content may be generated based on themaximum zoom curve 602 shown in FIG. 6B.

In some implementations, the stabilized visual content may be generatedbased on the viewing window having smoothed changes in the sizes as thefunction of progress through the progress length and/or otherinformation. That is, the viewing window for generating the stabilizedvisual content may have sizes that are determined smoothing of sizesdetermined based on the rotational positions of the image capture deviceat different moments during the capture duration. For example, thestabilized visual content may be generated based on the smoothed zoomcurve 604 shown in FIG. 6C.

In some implementations, the stabilized visual content may be generatedas an encoded version/copy of the stabilized visual content (e.g.,encoded video file) and/or a director track that defines the extents ofthe visual content to be used during playback. For example, thestabilized visual content may be generated as video frames in a videofile, and the video file may be opened in a video player forpresentation of the stabilized visual content. The stabilized visualcontent may be generated as instructions to render the visual contentfor presentation. The instructions (e.g., director track) may whichdefine visual portions of the visual content (images, video frames)should be included within the presentation of the video content. Theinstructions may include information on the location, size, shape,and/or rotation of the punchout of images/video frames to be used to asa function progress through the progress length of the visual content toprovide a stabilized view of the images/video frames. A video player mayuse the instructions to retrieve the relevant visual portions of theimages/video frames when the visual content is opened and/or is to bepresented.

The generation component 108 may be configured effectuate storage of thestabilized visual content and/or other information in one or morestorage media. For example, the stabilized visual content (e.g., videofile, director track) may be stored in the electronic storage 13, remotestorage locations (storage media located at/accessible through aserver), and/or other locations. In some implementations, the generationcomponent 108 may effectuate storage of the stabilized visual contentthrough one or more intermediary devices. For example, the processor 11may be located within a computing device without a connection to thestorage device (e.g., the computing device lacks WiFi/cellularconnection to the storage device). The generation component 108 mayeffectuate storage of the stabilized visual content through anotherdevice that has the necessary connection (e.g., the computing deviceusing a WiFi/cellular connection of a paired mobile device, such as asmartphone, tablet, laptop, to store information in one or more storagemedia). Other storage locations for and storage of the stabilized visualcontent are contemplated.

In some implementations, the processor 11 may represent multipleprocessors, and at least one of the processors may be a remote processorlocated remotely from the housing of the image capture device (e.g., theimage capture device 302). One or more of the functionalities of thecomponents 102, 104, 106, 108 may be performed by the image capturedevice 302 (e.g., by the processor 310) and/or by a remote processor.For example, viewing window determination (functionalities of theviewing window component 106) and/or stabilized visual contentgeneration (functionality of the generation component 108) may beperformed by the remote processor during and/or post capture of thevisual content by the image capture device. As another example,stabilized visual content generation may be performed by the processor310 during capture of the visual content to provide the stabilizedvisual content during capture of the visual content.

In some implementations, a representation of the viewing window may bepresented. For example, an image capture device capturing the visualcontent may determine the size, location, and/or the rotation of theviewing window during capture of the visual content and may display anoutline of the viewing window within a preview of the visual contentbeing captured. Such a presentation may allow a user to have a betterunderstanding of how much of the visual content that is being capturedis stabilizable and/or to modify use of the image capture device tocapture visual content by using the viewing window representation as aguide (e.g., using the outline of the viewing window overlaid overpreview of the visual content being captured to center the subject ofcapture within the viewing window).

In some implementations, the visual content may not be stabilizedin/near real time. For example, the image capture device may not havesufficient resource to apply the stabilization technique describedherein in real-time and/or may be devoting its resources to other tasks.The stabilization of the visual content may be performed by the imagecapture device once sufficient resource becomes available. Thestabilization of the visual content may be performed by the remoteprocessor. For example, the remote processor may be one or moreprocessors of a remote computing device (e.g., mobile device, desktop,server), and the remote processor may receive video information and therotational position information captured/generated by the image capturedevice. The remote computing device (software running on the remotecomputing device) may apply the stabilization technique described hereinpost capture of the visual content by the image capture device. Thepost-capture stabilization of the visual content may be performed by theremote processor responsive to reception of the video information androtational position information, responsive to user/system command tostabilize the visual content, responsive to the visual content beingopened for playback, and/or responsive to other conditions.

Implementations of the disclosure may be made in hardware, firmware,software, or any suitable combination thereof. Aspects of the disclosuremay be implemented as instructions stored on a machine-readable medium,which may be read and executed by one or more processors. Amachine-readable medium may include any mechanism for storing ortransmitting information in a form readable by a machine (e.g., acomputing device). For example, a tangible (non-transitory)machine-readable storage medium may include read-only memory, randomaccess memory, magnetic disk storage media, optical storage media, flashmemory devices, and others, and a machine-readable transmission mediamay include forms of propagated signals, such as carrier waves, infraredsignals, digital signals, and others. Firmware, software, routines, orinstructions may be described herein in terms of specific exemplaryaspects and implementations of the disclosure, and performing certainactions.

In some implementations, some or all of the functionalities attributedherein to the system 10 may be provided by external resources notincluded in the system 10. External resources may include hosts/sourcesof information, computing, and/or processing and/or other providers ofinformation, computing, and/or processing outside of the system 10.

Although the processor 11 and the electronic storage 13 are shown to beconnected to the interface 12 in FIG. 1, any communication medium may beused to facilitate interaction between any components of the system 10.One or more components of the system 10 may communicate with each otherthrough hard-wired communication, wireless communication, or both. Forexample, one or more components of the system 10 may communicate witheach other through a network. For example, the processor 11 maywirelessly communicate with the electronic storage 13. By way ofnon-limiting example, wireless communication may include one or more ofradio communication, Bluetooth communication, Wi-Fi communication,cellular communication, infrared communication, Li-Fi communication, orother wireless communication. Other types of communications arecontemplated by the present disclosure.

Although the processor 11 is shown in FIG. 1 as a single entity, this isfor illustrative purposes only. In some implementations, the processor11 may comprise a plurality of processing units. These processing unitsmay be physically located within the same device, or the processor 11may represent processing functionality of a plurality of devicesoperating in coordination. The processor 11 may be configured to executeone or more components by software; hardware; firmware; some combinationof software, hardware, and/or firmware; and/or other mechanisms forconfiguring processing capabilities on the processor 11.

It should be appreciated that although computer components areillustrated in FIG. 1 as being co-located within a single processingunit, in implementations in which processor 11 comprises multipleprocessing units, one or more of computer program components may belocated remotely from the other computer program components. Whilecomputer program components are described as performing or beingconfigured to perform operations, computer program components maycomprise instructions which may program processor 11 and/or system 10 toperform the operation.

While computer program components are described herein as beingimplemented via processor 11 through machine-readable instructions 100,this is merely for ease of reference and is not meant to be limiting. Insome implementations, one or more functions of computer programcomponents described herein may be implemented via hardware (e.g.,dedicated chip, field-programmable gate array) rather than software. Oneor more functions of computer program components described herein may besoftware-implemented, hardware-implemented, or software andhardware-implemented

The description of the functionality provided by the different computerprogram components described herein is for illustrative purposes, and isnot intended to be limiting, as any of computer program components mayprovide more or less functionality than is described. For example, oneor more of computer program components may be eliminated, and some orall of its functionality may be provided by other computer programcomponents. As another example, processor 11 may be configured toexecute one or more additional computer program components that mayperform some or all of the functionality attributed to one or more ofcomputer program components described herein.

The electronic storage media of the electronic storage 13 may beprovided integrally (i.e., substantially non-removable) with one or morecomponents of the system 10 and/or as removable storage that isconnectable to one or more components of the system 10 via, for example,a port (e.g., a USB port, a Firewire port, etc.) or a drive (e.g., adisk drive, etc.). The electronic storage 13 may include one or more ofoptically readable storage media (e.g., optical disks, etc.),magnetically readable storage media (e.g., magnetic tape, magnetic harddrive, floppy drive, etc.), electrical charge-based storage media (e.g.,EPROM, EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive,etc.), and/or other electronically readable storage media. Theelectronic storage 13 may be a separate component within the system 10,or the electronic storage 13 may be provided integrally with one or moreother components of the system 10 (e.g., the processor 11). Although theelectronic storage 13 is shown in FIG. 1 as a single entity, this is forillustrative purposes only. In some implementations, the electronicstorage 13 may comprise a plurality of storage units. These storageunits may be physically located within the same device, or theelectronic storage 13 may represent storage functionality of a pluralityof devices operating in coordination.

FIG. 2 illustrates method 200 for stabilizing videos. The operations ofmethod 200 presented below are intended to be illustrative. In someimplementations, method 200 may be accomplished with one or moreadditional operations not described, and/or without one or more of theoperations discussed. In some implementations, two or more of theoperations may occur substantially simultaneously.

In some implementations, method 200 may be implemented in one or moreprocessing devices (e.g., a digital processor, an analog processor, adigital circuit designed to process information, a central processingunit, a graphics processing unit, a microcontroller, an analog circuitdesigned to process information, a state machine, and/or othermechanisms for electronically processing information). The one or moreprocessing devices may include one or more devices executing some or allof the operation of method 200 in response to instructions storedelectronically on one or more electronic storage media. The one or moreprocessing devices may include one or more devices configured throughhardware, firmware, and/or software to be specifically designed forexecution of one or more of the operations of method 200.

Referring to FIG. 2 and method 200, at operation 201, video informationmay be obtained. The video information may define a video. The video mayinclude video content captured by an image capture device during acapture duration. The video content may have a progress length. Thevideo content may include visual content captured at different momentswithin the capture duration. The visual content may be viewable as afunction of progress through the progress length. The visual content mayhave a field of view. In some implementation, operation 201 may beperformed by a processor component the same as or similar to the videoinformation component 102 (Shown in FIG. 1 and described herein).

At operation 202, rotational position information of the image capturedevice may be obtained. The rotational position information maycharacterize rotational positions of the image capture device as afunction of progress through the capture duration. In someimplementation, operation 202 may be performed by a processor componentthe same as or similar to the position information component 104 (Shownin FIG. 1 and described herein).

At operation 203, a viewing window for the visual content as a functionof progress through the progress length may be determined based on therotational positions of the image capture device as the function ofprogress through the capture duration and/or other information. Theviewing window may define extents of the visual content to be includedwithin stabilized visual content as the function of progress through theprogress length. Determination of the viewing window may includedetermination of sizes of the viewing window as the function of progressthrough the progress length based on the rotational positions of theimage capture device as the function of progress through the captureduration and/or other information. In some implementation, operation 203may be performed by a processor component the same as or similar to theviewing window component 106 (Shown in FIG. 1 and described herein).

At operation 204, the stabilized visual content may be generated basedon the viewing window and/or other information. The stabilized visualcontent may include a punchout of the extents of the visual contentwithin the viewing window. In some implementation, operation 204 may beperformed by a processor component the same as or similar to thegeneration component 108 (Shown in FIG. 1 and described herein).

Although the system(s) and/or method(s) of this disclosure have beendescribed in detail for the purpose of illustration based on what iscurrently considered to be the most practical and preferredimplementations, it is to be understood that such detail is solely forthat purpose and that the disclosure is not limited to the disclosedimplementations, but, on the contrary, is intended to covermodifications and equivalent arrangements that are within the spirit andscope of the appended claims. For example, it is to be understood thatthe present disclosure contemplates that, to the extent possible, one ormore features of any implementation can be combined with one or morefeatures of any other implementation.

What is claimed is:
 1. A system for stabilizing videos, the systemcomprising: one or more physical processors configured bymachine-readable instructions to: obtain video information defining avideo, the video including visual content captured by an image capturedevice during a capture duration, the visual content having a progresslength, the visual content having a field of view; obtain rotationalposition information of the image capture device, the rotationalposition information characterizing rotational positions of the imagecapture device as a function of progress through the capture duration;determine placement of a viewing window within the field of view of thevisual content as a function of progress through the progress lengthbased on the rotational positions of the image capture device as thefunction of progress through the capture duration for stabilization ofthe visual content to compensate for motion of the image capture deviceduring the capture duration and for leveling of the visual content tocompensate for tilt of the image capture device during the captureduration, the viewing window defining extents of the visual content tobe included within stabilized and leveled visual content as the functionof progress through the progress length, wherein determination of theplacement of the viewing window includes determination of shape of theviewing window; and generate the stabilized and leveled visual contentto include the extents of the visual content within the viewing window.2. The system of claim 1, wherein the determination of the placement ofthe viewing window further includes determination of size of the viewingwindow.
 3. The system of claim 2, wherein the size of the viewing windowincreases or decreases as the function of progress through the progresslength.
 4. The system of claim 1, wherein the shape of the viewingwindow is determined based on the rotational positions of the imagecapture device.
 5. The system of claim 1, wherein the shape of theviewing window is determined based on user selection.
 6. The system ofclaim 1, wherein the shape of the viewing window is determined based oncontent captured within the visual content.
 7. The system of claim 6,wherein determination of the shape of the viewing window based on thecontent captured within the visual content includes determination of theshape of the viewing window based on identification of activity,subject, face, or emotion captured within the visual content.
 8. Thesystem of claim 1, wherein the determination of the shape of the viewingwindow includes determination of aspect ratio of the viewing window. 9.The system of claim 1, wherein the leveling of the visual content tocompensate for the tilt of the image capture device during the captureduration is performed based on direction of gravity.
 10. A method forstabilizing videos, the method performed by a computing system includingone or more processors, the method comprising: obtaining, by thecomputing system, video information defining a video, the videoincluding visual content captured by an image capture device during acapture duration, the visual content having a progress length, thevisual content having a field of view; obtaining, by the computingsystem, rotational position information of the image capture device, therotational position information characterizing rotational positions ofthe image capture device as a function of progress through the captureduration; determining, by the computing system, placement of a viewingwindow within the field of view of the visual content as a function ofprogress through the progress length based on the rotational positionsof the image capture device as the function of progress through thecapture duration for stabilization of the visual content to compensatefor motion of the image capture device during the capture duration andfor leveling of the visual content to compensate for tilt of the imagecapture device during the capture duration, the viewing window definingextents of the visual content to be included within stabilized andleveled visual content as the function of progress through the progresslength, wherein determination of the placement of the viewing windowincludes determination of shape of the viewing window; and generating,by the computing system, the stabilized and leveled visual content toinclude the extents of the visual content within the viewing window. 11.The method of claim 10, wherein determining the placement the viewingwindow further includes determining size of the viewing window.
 12. Themethod of claim 11, wherein the size of the viewing window increases ordecreases as the function of progress through the progress length. 13.The method of claim 10, wherein the shape of the viewing window isdetermined based on the rotational positions of the image capturedevice.
 14. The method of claim 10, wherein the shape of the viewingwindow is determined based on user selection.
 15. The method of claim10, wherein the shape of the viewing window is determined based oncontent captured within the visual content.
 16. The method of claim 15,wherein determining the shape of the viewing window based on the contentcaptured within the visual content includes determining the shape of theviewing window based on identification of activity, subject, face, oremotion captured within the visual content.
 17. The method of claim 10,wherein determining the shape of the viewing window includes determiningaspect ratio of the viewing window.
 18. The method of claim 10, whereinthe leveling of the visual content to compensate for the tilt of theimage capture device during the capture duration is performed based ondirection of gravity.
 19. A system for stabilizing videos, the systemcomprising: one or more physical processors configured bymachine-readable instructions to: obtain video information defining avideo, the video including visual content captured by an image capturedevice during a capture duration, the visual content having a progresslength, the visual content having a field of view; obtain rotationalposition information of the image capture device, the rotationalposition information characterizing rotational positions of the imagecapture device as a function of progress through the capture duration;determine placement of a viewing window within the field of view of thevisual content as a function of progress through the progress lengthbased on the rotational positions of the image capture device as thefunction of progress through the capture duration for stabilization ofthe visual content to compensate for motion of the image capture deviceduring the capture duration and for leveling of the visual content tocompensate for tilt of the image capture device during the captureduration, the viewing window defining extents of the visual content tobe included within stabilized and leveled visual content as the functionof progress through the progress length, wherein determination of theplacement of the viewing window includes determination of shape of theviewing window based on the rotational positions of the image capturedevice; and generate the stabilized and leveled visual content toinclude the extents of the visual content within the viewing window. 20.The system of claim 19, wherein the leveling of the visual content tocompensate for the tilt of the image capture device during the captureduration is performed based on direction of gravity.